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Abstract 


Using latent profile analysis (LPA), this study empirically identified dual-factor mental health 
subtypes, with a goal of examining structural stability of emerging latent classes over three high 
school years. Profiles’ relations with distal indicators of well-being, psychosocial distress, and 
self-reported grades were examined to explore the validity of emerging classes. A sample of 332 
high school students reported on their social-emotional strengths and psychological distress 
during the fall term of their ninth-, tenth-, and eleventh-grade years. In Grade 12, students 
reported on measures assessing their grades and social-emotional experiences. Independent 
LPAs for each grade year yielded four mental health subtypes — complete mental health, 
moderately mentally healthy, symptomatic but content, and troubled — and provided evidence for 
the structural stability of the dual-factor mental health construct. Across high school years, most 
students were in the complete or moderately mentally healthy classes, with the troubled class 
consistently representing the smallest proportion of the sample. Students in classes with higher 
levels of strengths and lower levels of distress reported higher grades, prosocial contribution to 
community, and higher life satisfaction, and fewer symptoms of anxiety and depression. 
Implications and future directions for research and school-based practice are discussed. 
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An Empirical Approach to Complete Mental Health Classification in Adolescents 


An approach to universal screening, complete mental health screening (You et al., 2014), 
offers a comprehensive picture of youth’s mental health functioning by assessing youth’s 
wellness and distress. This approach is based on dual-factor (Suldo & Shaffer, 2008) or two- 
continua (Westerhof & Keyes, 2010) models that consider psychological distress and social- 
emotional wellness as separate, yet related dimensions. The empirical literature substantiating a 
dual-factor model has most often relied on predetermined decision points when forming mental 
health groups that vary along indicators of distress and wellness (Kim, Dowdy, Furlong, & You, 
2017). However, limitations associated with the use of rational cut-score approaches to 
classification call for the exploration of alternative approaches (Kim et al., 2017). The aims of 
the current study are to: (a) explore an empirically based, latent profile approach to complete 
mental health classification; (b) investigate the structural stability of emerging groups over three 
years; and (c) explore the validity of emerging mental health groups via examining the relation 
of the empirically derived groups to self-reported grades and social-emotional outcomes. 


Defining Complete Mental Health 


Mental health is often defined as a bipolar dimension with mental health and mental 
illness on opposite ends of one continuum (e.g., Greenspoon & Saklofske, 2001). This model 
conceptualizes mental health in relation to mental illness, such that mental illness indicates the 
presence of emotional or behavioral distress or psychological disorder (e.g., as defined using the 
Diagnostic and Statistical Manual of Mental Disorders; American Psychiatric Association, 
2013), whereas mental health implies an absence of these conditions (e.g., Keyes, 2005). 
However, definitions of mental health are shifting to emphasize positive health indicators, 
including subjective well-being and social emotional assets (e.g., Scales 1999). For example, the 
World Health Organization defines mental health as, “‘a state of well-being in which every 
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individual realizes his or her own potential, can cope with the normal stresses of life, can work 
productively and fruitfully, and is able to make a contribution to her or his community” (2016). 
Contemporary mental health models that simultaneously consider psychosocial distress and 
wellness have emerged as an alternative to traditional bipolar models. These dual-factor or two- 
continua models propose that mental wellness and mental illness comprise separate continua, 
with levels of both wellness and distress varying within an individual. In these models, logically 
defined groups are formed based on responses to wellness and distress measures (Antaramian 
Huebner, Hills, & Valois, 2010), with youth who are described to have complete mental health 
exhibiting higher levels of well-being and lower levels of distress (Moore et al., 2015). In this 
paper, the term “mental health” is used to refer to an individual’s general psychological state of 
well-being, encompassing both their degree of mental health and degree of mental illness. The 
term “complete mental health” refers specifically to a dual-factor or two-continua model of 
mental health that calls direct attention to well-being and psychological distress. Specifically, 
individuals with complete mental health have high levels of strengths and low levels of distress. 


The dual-factor, complete mental health model has been supported for use with children 
(Greenspoon & Saklofske, 2001) and adolescents in middle (Antaramian et al., 2010; Suldo & 
Shaffer, 2008) and high school (Suldo, Thalji-Raitano, Kiefer, & Ferron, 2016). Although the 
tools used to define complete mental health and the constructs of well-being and distress have 
varied across empirical investigations, similar trends have emerged in the relation of dual-factor 
mental health groups to outcomes of interest. For example, adolescents with complete mental 
health have been found to have superior school engagement, academic achievement, school 
attendance, social relationships and functioning, physical health, and identity development 
(Lyons, Huebner, & Hills, 2013; Suldo et al., 2016). Moreover, among youth who experience 
distress, the presence of well-being has a buffering effect on outcomes. Despite findings of 
differential functioning based upon dual-factor mental health group membership, the criteria 
used to form dual-factor mental health groups is not a settled matter because cut-points are 
researcher defined and vary across studies. Thus, a primary goal of this study was to explore an 
alternative, person-centered empirical classification approach that allows groups to emerge based 
upon similarities among members within a sample. An empirical approach lends itself to cross- 
study standardization (Masyn, 2013) and could refine the understanding of the characteristics of 
adolescent dual-factor mental health groups (Nylund, Bellmore, Nishina, & Graham, 2007). 


Classification of Complete Mental Health 


The majority of research on dual-factor mental health has classified individuals based 
upon a rationally formed dichotomous categorization scheme for each of the well-being and 
distress dimensions (e.g., Kim et al., 2017). That is, cut points are specified to distinguish 
individuals who are considered to be experiencing high versus low levels of well-being and 
distress. Using a dichotomous cut score approach to classification, four mental health groups are 
logically formed across all investigations (e.g., Greenspoon & Saklofske, 2001; Lyons et al., 
2012; Venning, Wilson, Kettler, & Eliott, 2013) and include groups of individuals with (a) high 
well-being and low distress (e.g., complete mental health), (b) high well-being and high distress 
(e.g., Symptomatic but content), (c) low well-being and low distress (e.g., vulnerable or 
languishing), and (d) low well-being and high distress (e.g., troubled). A variety of criteria have 
been used for categorization based upon differing cut points. For example, some research used 
established decision points for norm-referenced measures (e.g., T-scores of 60 and above to 
indicate elevated risk), whereas others used values based upon individuals’ raw scores, sample 
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means, or standardized scores (Kim et al., 2017). Others have used predetermined criteria in 
selecting raw- or mean-score cut points (e.g., such that 30% of the sample is classified as having 
low well-being; e.g., Antaramian et al., 2010; Suldo & Shaffer, 2008). Assigning youth to either 
high or low well-being and high or low distress categories forms the four mental health groups. 


Although the cut score approach forms unique mental health groups, the resulting 
membership in the four groups is just one of many possible group assignments that are 
dependent upon the number of cut points selected and the criteria used. An inherent disadvantage 
of this approach to classification is that most often there are no clear criteria regarding where to 
set cut points or if four groups is the optimal number of groups (e.g., Nylund Asparouhov, & 
Muthén, 2007). Classification via the cut score approach can be insensitive to the degree of 
variation in mental health among youth (Kim et al., 2017). For example, when dichotomous 
classification criteria are specified such that youth scoring above the 30" percentile on a well- 
being measure are indicated to have high well-being, individuals exhibiting moderate levels of 
well-being (e.g., 40" percentile) are regarded as having similar levels of well-being as those 
individuals with the highest levels of well-being (e.g., 90" percentile; Kim et al., 2017). As such, 
the mental health groups formed are treated as homogenous when they have substantial 
heterogeneity, which incompletely captures the complexity of youths’ mental health experiences. 


Additionally, when sample-dependent criteria are used across studies, an individual 
classified into one mental health group when one set of criteria are used, may be in a different 
group when using another set of criteria; hence, replication is problematic. For example, 
considering the four complete mental health groups, the majority of adolescents have been 
classified as experiencing complete mental health [42% (Venning et al., 2013) to 64% (Lyons et 
al., 2012)], followed by symptomatic but content [9% (Lyons et al., 2012) to 36% (Venning et 
al., 2013)], troubled [8% (Antaramian et al., 2010) to 20% (Lyons et al., 2012)], and languishing 
[5% (Venning et al., 2013) to 13% (Suldo & Shaffer, 2008)]. The observed differences in the 
proportion of youth who are classified into each mental health group within each study’s sample 
might be an artifact of sample-specific characteristics; however, they could also indicate 
disparities in classification that are observed when criteria used to classify individuals’ mental 
health vary across investigations. A person-centered, empirical approach to classification that 
identifies groups (i.e., latent classes or profiles) based upon individual observed response pattern 
provides an alternative approach for identifying emerging groups (Nylund et al., 2007b). 


Latent Profile Analysis: Person-Centered Approach to Classification 


Latent profile analysis (LPA) is a person-centered, empirical approach to classifying the 
heterogeneity within groups of people (Masyn, 2013; Vermunt, 2004). LPA identifies differences 
and similarities among individuals with respect to how variables measuring constructs of interest 
are related to each other. LPA is performed in an exploratory manner and assumes that the 
underlying population is heterogeneous but also that the population consists of a finite number of 
meaningful, more homogenous groups (Laursen & Hoff, 2006; Masyn, 2013). A categorical 
latent variable, indicative of group membership, is specified to identify unobserved (latent) 
groups (also called classes or profiles) based upon similarities in their response patterns across 
indicators. Through a model building process wherein numerous models specify increasingly 
more classes, statistical criteria are used to evaluate the resulting models and to decide on the 
number of latent groups. Rather than predetermining the number of groups to be formed using 
cut points, LPA allows for meaningful classes to be empirically identified, and then evaluated for 
accuracy and validity. Thus, when well-being and distress are examined concurrently, LPA 
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allows for groups to emerge that may differ in both dimension (i.e., presence of well-being but 
absence of distress) and relative severity (i.e., varying levels of well-being and/or distress). 


Two previous studies (Kim et al., 2017; Rebelez-Ernst, 2015) examined dual-factor 
mental health using an LPA approach to classification. In each study, separate latent class 
models were specified for social-emotional strengths and psychological distress, with classes 
from the best-fitting strength and distress models being cross-tabulated to form complete mental 
health groups. Kim and colleagues (2017) identified five profiles of strengths and three profiles 
of distress whereas Rebelez-Ernst (2015) identified four profiles of strengths and four profiles of 
distress. When the emerging strength and distress profiles were cross-tabulated, Kim et al. (2017) 
and Rebelez-Ernst (2015) identified 15 and 16 complete mental health groups, respectively. 
However, when examining the proportion of students in each of these samples in each emerging 
mental health group, many of the emerging groups described fewer than 5% of the study’s 
participants, calling into question the practicality of each group for informing prevention or 
intervention efforts. In addition, although these previous LPA investigations examined both 
positive and negative indicators of mental health using a dual-factor approach, adolescents’ 
characteristics on each element of mental health were considered separately and then cross- 
tabulated to form the final groups, as has been done with the traditional cut score classification 
approach. Research examining parsimonious approaches to LPA classification, specifying 
models that examine well-being and distress simultaneously, is needed to better inform use of 
data to identify youths’ mental health subtypes. Research investigating whether the number of 
emerging mental health groups is consistent over time (1.e., structural stability) is also needed. 


Study Aims 


LPA was used to empirically define complete mental health groups assessed via universal 
screening data. Across three years, adolescents reported on their social-emotional strengths and 
psychological distress. LPA analyses performed for adolescents in each of Grades 9-11 were 
designed to examine whether patterns in dual-factor mental health were consistent at different 
points. Research that empirically identifies dual-factor mental health groups is limited; there are 
only a few investigations that examined emerging classes and these examinations were cross- 
sectional (e.g., Kim et al., 2017). Thus, the repeated LPA analyses of this study are intended to 
provide important information about the nature of empirically derived dual-factor mental health 
groups within the high school period, including whether the observed dual-factor mental health 
construct emerges similarly (i.e., consistent number of groups, consistent characteristics or 
structure of groups) with repeated measurements within this developmental period. Given the 
exploratory nature of LPA analyses, no hypotheses were specified a priori regarding the number 
and characteristics of emerging mental health groups. However, similar dual-factor mental health 
groups emerging over each grade year would provide information about the nature of dual-factor 
mental health in high school students in addition to providing preliminary validation evidence for 
empirically-derived, person-centered dual-factor mental health. Thus, the LPA analyses that are 
the focus of this study were intended to examine whether dual-factor mental health profiles are 
consistent at different time points during high school (i.e., structural stability), and were not 
designed to track changes in individual students’ mental health group membership over time. 
Finally, the current study sought to examine the validity of emerging classes via exploring the 
relation of group membership with later self-reported grades and social-emotional outcomes. In 
particular, the relation between adolescents’ mental health class in each of Grades 9—11 with 
Grade 12 self-reported grades and positive and negative social-emotional outcomes was 
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explored. Thus, the present study seeks to contribute to the youth mental health literature by (a) 
identifying subtypes of dual-factor mental health using an empirically derived latent class 
approach to classification, (b) examining the structural stability of these classes at three different 
time points across three years of high school, and (c) assessing how empirically derived mental 
health classes predict Grade 12 self-reports of grades and social-emotional outcomes. 


Method 
Participants 


Participants attended one high school in central California that participated in an ongoing 
screening project occurring over four consecutive years. Participants for this study first 
completed the study survey as ninth graders and annually thereafter. Of the 497 students who 
completed the Grade 9 survey, 334 (67%) had parent consent and youth assent to complete the 
Grade 12 survey. Individuals who had at least three years of data across the four possible years 
when the survey was conducted were included in the present analyses (N = 332). Two students 
who completed only the Grade 9 and Grade 12 surveys were excluded from these analyses. 
Using these criteria, the final sample for each year was: 332 (Grade 9), 324 (Grade 10), and 291 
(Grade 11). Information obtained from students’ archival school records in Grade 9 indicated 
that the participating sample was 48.5% female, 43.9% Latinx or Hispanic, 37.9% non-Hispanic 
White, 7.5% Asian or Pacific Islander, 1.2% African American, and 0.9% American Indian or 
Alaska Native. Race or ethnicity information was unavailable for 8.4% of the participants. In the 
current study, 47.3% of students were classified as socioeconomically disadvantaged and 8.4% 
were eligible to receive special education services. No significant differences with respect to 
these demographic characteristics were observed between participants included in the final 
sample and those who were not included due to attrition (y? > .05). 


Procedures 


Each year, for four consecutive years, all students in Grades 9-12 were invited to 
participate in universal screening. During the first month of each academic year, following 
approval by the university’s institutional review board, district approval, passive parental 
consent, and youth assent, school personnel administered the screening surveys to participating 
students in a group format during one period of a regular school day. The screening survey 
included all self-report measures. Administration scripts were provided to all classroom teachers. 


Data were collected in the fall semester of 2013-2014 (Grade 9), 2014-2015 (Grade 10), 
2015-2016 (Grade 11), and 2016-2017 (Grade 12). Students completed a survey electronically 
via an online format during Grades 9, 11, and 12. At the request of the school’s administration, 
surveys were completed using paper-and-pencil format during Grade 10 data collection. Each 
year, within the two weeks following initial data collection, students who were absent on their 
class’s initial screening day were provided with up to five additional opportunities to complete 
the survey. During the fall of Grades 9-11, the well-being and distress measures used in the 
LPAs were administered. In order to examine the validity of students’ emerging complete mental 
health class, five additional self-report measures of grades or social-emotional outcomes were 
administered concurrently with the screening survey, in the first month of Grade 12. 


Measures 


The following section provides a summary of the measures used in this study. Table 1 
shows the alpha internal consistency coefficients and the item response range for each measure. 
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Complete mental health measures. 


Social Emotional Health Survey-Secondary (SEHS-S). The 36-item SEHS-S (You et 
al., 2014) assesses four positive mental health domains each comprised of three strength 
dispositions: belief-in-self (comprised of self-efficacy, self-awareness, persistence), belief-in- 
others (school support, peer support, family coherence), emotional competence (emotional 
regulation, empathy, self-control), and engaged living (optimism, gratitude, zest). Students 
responded to statements related to their social-emotional functioning using an ordinal-response 
scale. On the gratitude and zest subscales, a 5-point response scale is used (1 = not at all, 2 = 
very little, 3 = somewhat, 4 = quite a lot, 5 = extremely). For each of the other 10 dispositions, 
adolescents indicated how true each statement is for them (1 = not at all true of me, 2 = a little 
true of me, 3 = pretty much true of me, 4 = very much true of me). Mean scores for the four 
belief-in-self, belief-in-others, emotional competence, engaged living domains were computed 
and used as indicators of well-being for each year of data collection and used in the LPAs. 


Strengths and Difficulties Questionnaire (SDQ). The SDQ is a 25-item self-report 
measure of youths’ behavior and feelings (past six months; Goodman, 1997). Respondents use a 
three-point response scale (1 = not true, 2 = somewhat true, 3 = certainly true). A three-factor 
structure (emotional distress/withdrawal, behavioral reactivity/conduct problems, and prosocial 
behaviors/peer competence; Ruchkin, Jones, Vermeiren, & Schwab-Stone, 2008) supports better 
reliability estimates over the original five SDQ factors (Goodman, 1997). The five highest 
loading items in the Ruchkin et al. (2008) study, were used for emotional distress/withdrawal 
(items 3, 6, 8, 13 and 16; A = .47 to .60) and behavioral reactivity/conduct problems (items 2, 5, 
10, 15, and 22; = .56 to .62; contact first author for additional information). Mean internalizing 
(i.e., emotional distress/withdrawal items) and externalizing (1.e., behavioral reactivity/conduct 
problems items) scores for each year were used as indicators in the LPAs. 


Grade 12 psychosocial outcomes. 


Self-reported grades. Adolescents reported on their grades over the previous 12 months 
via one item from the California Healthy Kids Survey (“During the past 12 months, how would 
you describe the grades you mostly received in school?”; California Department of Education, 
n.d.). Students used an eight-point response scale (1 = mostly F’s ... 8 = mostly A’s). Self- 
reported grades are often used (Kuncel, Credé, & Thomas, 2005) with some research showing 
their acceptable reliability for high school students (Sticca et al., 2017) and other research 
indicating that these data are to be interpreted with caution (Kuncel et al., 2005). 


Brief Multidimensional Students’ Life Satisfaction Scale (BMSLSS). The BMLSS has 
five items measuring five domains of life satisfaction (friends, family, self, school, and living 
environment; Seligson, Huebner, & Valois, 2003). The BMSLSS scores have acceptable 
convergent validity with other life satisfaction measures and positive affect (Seligson et al., 
2003). A five-point response scale (1 = very dissatisfied to 5 = very satisfied) was used in this 
study. A mean score, indicating total life satisfaction, was computed with higher scores 
indicating greater overall life satisfaction. 


Contribution to community. The Contribution subscale (Pilkauskaite-Valickiene, 2015) 
of the Positive Youth Development Inventory (PYDI; Arnold, Nott, & Meinhold, 2012) is a 
seven-item measure of youths’ perception of community contribution (e.g., “I am someone who 
gives to benefit others”). A four-point response scale is used (1 = strongly disagree to 4 = 
strongly agree). In this study, a mean contribution score was computed, with higher scores 
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indicating greater degrees of competence in this domain. 


Patient Health Questionnaire (PHQ-9). The PHQ-9 (Kroenke, Spitzer, & Williams, 
2010) is a self-report measure of depressive symptoms corresponding to the nine Diagnostic and 
Statistical Manual (DSM) criteria for major depression. Using a four-point response scale (1 = 
not at all, 2 = several days, 3 = more than half the days, 4 = nearly every day), respondents 
indicated how often they experienced symptoms within the previous two weeks. The PHQ-9 has 
support for use with adolescents (Richardson, McCauley, & Katon, 2009) and has demonstrated 
adequate psychometric properties, including good sensitivity and specificity (Kroenke et al., 
2010). Eight items were used in this study. One item (item 9, “Thoughts that you would be better 
off dead of or hurting yourself in some way’) was not included because of school administrators’ 
concerns about their ability to promptly respond to students who endorsed this item. A mean 
score was computed, with higher scores indicating greater severity of depressive symptoms. 


Generalized Anxiety Disorder Scale (GAD-7). The GAD-7 is a seven-item self-report 
anxiety measure (Kroenke et al., 2001; Spitzer, Kroenke, Williams, & Lowe, 2006). Using a 
four-point response scale identical to the PHQ-9, respondents indicated how often they had 
experienced symptoms related to anxiety within the previous two weeks. A mean score was 
computed, with higher scores indicating greater severity of anxiety symptoms. 


Data Analytic Strategy 


A series of LPAs were performed to examine the underlying number of latent groups 
among dual-factor mental health indicators for adolescents in each of Grades 9, 10, and 11 using 
Mplus version 7.4 (Muthén & Muthén, 1998-2015). Models were specified using mean scores 
from the four domains of the SEHS-S [belief-in-self (BIS), belief-in-others (BIO), engaged living 
(EL), emotional competence (EC)] and two domains of the SDQ [internalizing risk (INT) and 
externalizing risk (EXT)] as indicators of well-being and distress, respectively. Given the 
continuous nature of the indicators used in this study, a subset of latent class analysis (LCA), 
LPA, was used (Vermunt, 2004). Both LCA and LPA specify an underlying categorical latent 
variable which identifies classes, thus we use the term “classes” to refer to the emergent latent 
groups or profiles. The model building process requires fitting several possible LPAs for each 
grade and then comparing the model fit information and substantive interpretation of each model 
so as to determine which is the most appropriate (Nylund et al., 2007a). In LPA, classes can vary 
with respect to their indicator means, indicator variances, and covariances between indicators. In 
this study, two model structures were examined for each number of latent classes across each 
year: (a) Model 1 in which item variances are freely estimated but constrained to be equal across 
classes (1.e., class-invariant) with no within-class indicator covariances (i.e., diagonal), and (b) 
Model 2 in which indicator variances are freely estimated and are not constrained to be equal 
across Classes (i.e., class-varying) with no within-class indicator covariances (i.e., diagonal). 


A small percentage of individuals had missing responses on items contributing to SEHS- 

S, SDQ, or distal outcome composite score indicators. Missing item responses were accounted 
for within each subscale before computing composites. Mean composite scores were calculated 
only for individuals for whom at least 75% of items were answered within a given composite, 
which only resulted in 1.2% of the sample having indicator-level missingness across all grade 
years. Patterns of item-level missing data were examined, and no systematic pattern of missing 
data emerged. Additionally, independent samples t-tests did not yield significant differences in 
Grade 9 on SEHS-S or SDQ indicators for students who did and did not complete the survey in 
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Grades 10 or 11. Chi-square tests also did not yield significant differences between these 
individuals on demographic indicators. Thus, data were assumed to be missing at random 
(MAR). Indicator level missingness is accounted for via Full Information Maximum Likelihood 
(FIML; Enders & Bandalos, 2001) used in the Mplus LPA analyses, which allows for item-level 
(i.e., indicator level) missingness under the MAR assumption. 


Class enumeration and retention. A series of LPA models were fit in an effort to select 
a model with a number of classes that sufficiently describe the heterogeneity in the indicators 
(Masyn, 2013; Nylund, 2007). The number of latent classes was systematically increased by one 
until empirical support was not evidenced for additional classes, for example due to failures in 
model convergence or emergence of small or conceptually opaque classes (Nylund et al., 2007b). 
The model judged to most adequately capture the sample’s heterogeneity was selected as the best 
fitting model for each LPA. In determining the appropriate number of latent classes, Masyn 
(2013) recommends examining (a) evaluations of absolute fit, (b) evaluations of relative fit, and 
(c) evaluations of classification. Evaluations of absolute fit are not applicable to LPA, thus, 
relative fit indices were relied upon in the current study. 


Evaluations of relative fit assess model fit by comparing a target model to an alternative 
model with a different number of latent classes and include the information criteria statistics, 
such as the Bayesian Information Criteria (BIC; Schwartz, 1978), Bayes Factor (BF), correct 
model probability (cmP), Bootstrap Likelihood Ratio Test (BLRT; McLachlan & Peel, 2000), 
and Vuong Lo Mendel Rubin LRT (VLMR-LRT; Vuong, 1989). When interpreting the BF, 
values between | and 3 offer weak evidence, between 3 and 10 offer moderate evidence, and 
greater than 10 offer strong evidence for the current model (Wasserman, 1997). Larger cmP 
values indicate a greater likelihood of the model being the correct model out of all models tested 
(Masyn, 2013). The BLRT and the VLMR-LRT tests examine the fit of a k-class model with a k- 
1 class solution, with non-significant p-values indicating support for the k-1 class solution. With 
regard to information criteria statistics, superior model fit is indicated by lower values. Accuracy 
of classification of individuals to latent classes within a given model was examined based upon 
estimates of posterior class probability (1.e., the likelihood of each individual’s membership in a 
given class, based upon his or her pattern of responses) and relative entropy (Ramaswamy, 
DeSarbo, Reibstein, & Robinson, 1993). High entropy has been associated with values close to 
.80 (Clark & Muthén, 2009), with values closer to 1 indicating superior classification precision 
(Masyn, 2013). Each of the above criteria was evaluated in selecting and interpreting all models. 


Specification of conditional models with demographic covariates and distal 
outcomes. Following specification of unconditional, cross-sectional LPA models for Grades 9, 
10, and 11, and selection of the final model for each grade year, covariates of gender and 
ethnicity (Latinx, non-Latinx) and distal self-reports of grades and social-emotional outcomes 
were included in the model to explore the validity of emerging latent classes. Gender and 
ethnicity covariates were included to account for significant associations between these 
demographic indicators and the distal psychosocial outcomes of interest in this study and for 
significant associations with well-being and psychopathology that have been documented in 
previous research (e.g., Merikangas et al., 2010, Merikangas, Nakamura, & Kessler, 2009). 
When covariates and distal outcomes are examined concurrently, the manual BCH method, a 
three-step approach, is current best practice (Asparouhov & Muthén, 2015). Using this method, 
(a) the latent class indicator is regressed onto the demographic covariates, (b) the distal outcomes 
are regressed onto the latent class indicator, and (c) the distal outcomes are regressed onto the 
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covariates. When examining the relation between the latent classes and the covariates, the 
covariates maintain their dichotomous coding (i.e., 0, 1). However, when examining the direct 
relation between the distal outcomes and the covariates, the covariates are mean centered to 
allow for ease of interpretation of the conditional means produced for each outcome. That is, 
means, conditioned on (1.e., controlling for) the covariates, are estimated for each outcome for 
each emerging complete mental health class for each of Grades 9—11. The estimated means are 
then compared across class to identify any significant differences between classes on the distal 
outcomes measured. Contact first author for example syntax for these analyses. 


Results 
Latent Profile Analyses: Identification of Dual-Factor Mental Health Classes 


Mean item responses for the mental health indicators and predictive validity outcomes are 
presented in Table 1. Cross-sectional LPA models were run for Grades 9, 10, and 11. A one-class 
model was tested first and then additional models with additional latent classes were explored. 
Given the LPA framework, both the class-invariant, diagonal (Model 1) and class-varying, 
diagonal (Model 2) model structures were tested. Table 2 presents the information used to 
evaluate each model, including fit statistics, entropy values, and class prevalence proportions. 
Examining the results for Grade 9, the BIC, cmP, and BF indicate that the four-class class- 
invariant, diagonal model fit best. Although the five-class solution also had support (BIC = 
2589.87, BF = 23.80), examination of class prevalence information indicated that the additional 
fifth class explained variance in an unreliably small percentage of people (1.0% or 3.32 people). 
Thus, the four-class solution was chosen as the best fitting model. Model 2 structures for Grade 
9, 10, and 11 models with greater than four, three, or two classes, respectively across years, 
demonstrated failed log likelihood convergence for 20% to 82% of runs, indicating model 
instability despite the produced fit criteria. Thus, best fitting models were selected with Model 1 
structure for each grade year. Further examination of fit criteria across each grade year also 
supported a four-class solution for Grades 10 and 11. The observed entropy values of the best- 
fitting four-class solutions approximated high levels of entropy, with values ranging from .78 
(Grades 9 and 10) to .82 (Grade 11) and indicate that for at least 78% to 82% of the time, 
individuals were correctly classified in latent classes (Clark & Muthén, 2009). Therefore, a four- 
class model was deemed the optimal model for Grades 9, 10, and 11. 


The profile plots of the estimated mean values for each mental health domain are 
presented in Figure 1. Based on the pattern of mean scores across the well-being (i.e., SEHS-S) 
and distress (1.e., SDQ) domains, the following labels are offered for the four emerging classes 
across each year: complete mental health (30.5%, Grade 9; 40.8%, Grade 10; 20.5%, Grade 11) 
with the highest means on the well-being domains and the lowest means on the distress domains, 
moderately mentally healthy (43.4%, 32.0%, 44.3%, respectively) with high-average means on 
the well-being indicators and low means on the distress domains, symptomatic but content 
(20.3%, 21.2%, 31.3%, respectively) also with high-average well-being but with higher mean 
scores on the distress indicators, and troubled (5.7%, 6.0%, 3.8%, respectively) with below- 
average well-being and average to above-average scores on the distress indicators. When naming 
the classes, we aimed to be descriptive and also consistent with the dual-factor nomenclature 
presently used. When examining the size of each class across years, the troubled class 
consistently had the smallest percentage of students. Most students exhibited high or high- 
average scores on the well-being indicators with low levels of reported distress on the distress 
indicators (i.e., complete mental health or moderately mentally healthy). Overall, a larger 
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percentage of students fell into mental health classes characteristic of higher levels of distress by 
Grade 11 (i.e., troubled or symptomatic but content). Youth in mental health classes 
characteristic of higher levels of distress, particularly in Grades 10 and 11, tended to report 
higher levels of internalizing distress as compared to externalizing distress. 


Table 3 presents the average posterior class probability (AvePP; Masyn, 2013) of 
students being classified into each mental health class, given their classification into one mental 
health class. For example, in Grade 9, the probability of individuals in the moderately mentally 
healthy class being classified into the complete mental health class was .08. The values in the 
shaded cells presented on the diagonal for each grade level illustrate the probability that 
members of a given class would be classified into that class (1.e., classification accuracy). The 
accuracy of classification for each mental health class across years was high (> .80). 


Predictive Validity of the LPA Classes 


To examine the predictive validity of the LPA classes, we examined if self-reported 
grades and social-emotional indicators differed across the four mental health classes. Prosocial 
contribution to community, life satisfaction, depression symptoms, anxiety symptoms, and self- 
reported grades, measured in Grade 12, were distal outcomes in these analyses. We examined 
differences between mental health classes in each of Grades 9-11 using the five outcome 
indicators. Moreover, because both covariates and distal outcomes were examined in the current 
analyses, the manual BCH method was used so that the relation between the covariates and distal 
outcomes was controlled when examining differences on the distal outcomes based on latent 
class membership. Thus, the results presented reflect the effect of latent class membership on 
each distal outcome at the average level of the gender and ethnicity covariates while controlling 
for the direct relation between the distal outcomes and gender and ethnicity. 


Table 4 presents the class specific means and standard errors on each outcome for the 
Grade 9, 10, and 11 analyses, after controlling for the direct relations between the outcomes and 
the gender and ethnicity covariates. To test which mental health classes differed in their mean 
outcome scores, a Wald Test was conducted on all between-group comparisons. A conservative 
p-value (.01) was used to adjust for increased error due to multiple tests. Few differences 
between classes in each of Grades 9, 10, and 11 were observed with respect to self-reported 
grades. No significant differences were observed for Grade 9, with the Grade 10 and 11 
differences reflecting higher grades for students in the complete mental health or moderately 
mentally healthy classes with respect to the symptomatic but content class. 


Class specific differences were observed for the positive mental health outcomes of 
prosocial contribution to community and life satisfaction. Students in the complete mental health 
and moderately mentally healthy classes had significantly greater prosocial contribution than the 
symptomatic but content and troubled classes. The Grade 9 and Grade 11 complete mental health 
and moderately mentally healthy classes similarly reported higher average levels of life 
satisfaction in Grade 12 than the symptomatic but content and troubled classes. The Grade 10 
complete mental health class had significantly greater life satisfaction than all other classes. In 
Grade 11, adolescents in the symptomatic but content and troubled classes significantly differed, 
with students in the symptomatic but content class who reported higher levels of well-being also 
reporting greater levels of life satisfaction. 


Students in the symptomatic but content and troubled classes tended to report more 
frequent symptoms of depression and anxiety, on average, than did students in the complete 
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mental health and moderately mentally healthy classes. Patterns were largely consistent across 
both depression and anxiety outcomes for classes in each of Grades 9-11. However, minor 
variations were observed between classes for each grade year. For example, when Grade 12 
outcomes were examined for Grade 9 classes, contrary to classes in the other grade years, 
students in the Grade 9 symptomatic but content class had significantly higher levels of 
depression in Grade 12, but not anxiety, than students in the troubled class. However, of the 
Grade 11 classes, students in the troubled class had significantly higher levels of anxiety in 
Grade 12, but not depression, than did students in the symptomatic but content class. 


Groups reporting higher levels of well-being with low levels of distress tended to exhibit 
more positive outcomes on both the positive mental health and negative mental health indicators. 
Similarly, groups reporting higher levels of distress tended to experience poorer outcomes on the 
negative indicators of mental health. The complete mental health class was generally associated 
with the most positive outcomes up to three years later (1.e., better self-reported grades, higher 
average scores on positive mental health outcomes, lower average scores on negative mental 
health outcomes). However, the complete mental health class did not unanimously experience 
more positive outcomes than the moderately mentally healthy class, which had slightly lower 
average well-being. Similarly, though not always exhibiting significant differences between one 
another or with the other two classes, the symptomatic but content and troubled classes tended to 
experience poorer outcomes, especially with regard to negative mental health outcomes. 


Discussion 


Previous dual-factor research has most often classified youth into four groups based on 
logically determined cut points for well-being and distress indicators. In the current study, we 
relied on patterns in adolescents’ reports about their own mental health functioning to inform the 
most relevant mental health grouping. In each of Grades 9—11 the LPA results supported a four- 
class solution. These latent classes were examined at three points across the high school years to 
evaluate if the construct of dual-factor mental health was stable over time. We found structural 
stability in the latent dual-factor mental health construct over three years. The four-class solution 
consisting of a complete mental health (i.e., high well-being and low distress), moderately 
mentally healthy (i.e., high-average well-being, low distress), symptomatic but content (i.e., high- 
average well-being, average to above-average distress), and troubled (1.e., below-average 
wellbeing, average to above-average distress) class was replicated for each of Grade 9, 10, and 
11. Despite minor fluctuations observed in the average scores for the well-being and distress 
indicators for each class, the substantive interpretation for each solution is consistent over time. 


Consistent with previous dual-factor research, classes fitting each of a complete mental 
health, troubled, and symptomatic but content profile emerged in the current study. However, 
inconsistent with previous cut score and empirical classification work (e.g., Rebelez-Ernst, 
2015), a languishing or vulnerable group, indicative of low well-being and low distress, did not 
emerge in the current study. Rather, the fourth emerging mental health group (i.e., students who 
are moderately mentally healthy) reported average to above average well-being and below 
average distress. As can be seen in the profile plots in Figure 1, this fourth emerging group 
reported similar levels of well-being as the symptomatic but content class in Grades 9 and 10 
(although it was more differentiated from the symptomatic but content group in level of well- 
being in Grade 11), but markedly lower levels of distress, particularly as related to internalizing 
problems. The inability to detect a languishing group in the current study may indicate that a 
small number of students fit this profile making them statistically unreliable and difficult to 
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detect within an LPA framework. Replication with larger, independent samples is warranted. 


The patterns observed in levels of strengths in the current study indicate that 
understanding adolescents’ well-being may be more nuanced than described in previous dual- 
factor work. For example, rather than simply indicating lower versus higher well-being via a 
predetermined cut point, the LPA results reveal a gradient of well-being, with three of the four 
emerging mental health groups consistently differing in their average levels of social-emotional 
strengths. Empirically defining complete mental health groups allows for a group of youth with 
the highest levels of well-being and the lowest levels of distress (i.e., complete mental health) to 
be distinguished from those youth with high-average levels of well-being and low levels of 
distress (moderately mentally healthy). Within the cut-point classification approach, youth in the 
moderately mentally healthy class may have been considered to have complete mental health. 


Although the same four classes emerged across the exploratory LPA analyses for each of 
Grades 9, 10, and 11, indicating consistency in the construct of dual-factor mental health over 
time, the proportions of students comprising each mental health class were variable. In each 
grade year, the majority of students were classified into the complete mental health and 
moderately mentally healthy classes. However, in Grades 9 and 11 moderately mentally healthy 
students represented over 40% of the sample, whereas the complete mental health group was 
largest (41%) in Grade 10. The troubled class exhibited consistency in size; whereas the 
symptomatic but content group increased over time, reaching 31% by Grade 11 compared to 20% 
in Grade 9. Similarly, the complete mental health class was smallest (21%) in Grade 11, 
compared to 31% in Grade 9 and 41% in Grade 10. These fluctuations in class prevalence 
observed over time suggest that movement is occurring across classes from year to year. 
Additional research is needed to examine factors (e.g., individual level, school-context level) 
contributing to movement among classes and associated fluctuations in class proportions. The 
proportions of students in the complete mental health and moderately mentally healthy classes in 
the current study are similar to rates reported by Keyes (2006) who found that, among 
adolescents aged 15 to 18, most reported being moderately mentally healthy (55%) followed by 
flourishing (40%; i.e., complete mental health). However, the percentage of students in emerging 
complete mental health classes in the current study (Grade 9 = 31%, Grade 10 = 41%, Grade 11 
= 21%) is consistently smaller than percentages reported in previous dual-factor research using a 
cut-score approach [e.g., 42% (Venning et al., 2013) to 64% (Lyons et al., 2012)]. This suggests 
that the number of youth exhibiting complete mental health may be overestimated when cut- 
point criteria are applied rather than when groups are formed based on patterns in observed data. 


This study examined the validity of the complete mental health classes via their relations 
with Grade 12 outcomes. Our findings identified class differences in self-reported grades and 
positive (prosocial contribution to community and life satisfaction) and negative (depression 
symptoms and anxiety symptoms) mental health indicators. Students in classes indicative of 
higher average scores on well-being indicators and lower average scores on distress indicators 
tended to have higher scores on positive indicators of mental health and lower scores on negative 
indicators of mental health over time, which provides validation evidence for the four emerging 
classes and of the dual-factor mental health construct. Consistent with previous research, we 
found that students in the complete mental health class experienced the most favorable outcomes 
across grade years, followed by students in the moderately mentally healthy class, with these two 
groups differing significantly from one another in approximately half of the comparisons made. 
Also consistent with previous research, students in the troubled class tended to experience the 
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least favorable outcomes, although their self-reported outcomes were not always statistically 
significantly different from youth in the symptomatic but content class or from the moderately 
mentally healthy and complete mental health classes. However, given the much smaller size of 
the troubled class in the current study (i.e., approximately 6% or 20 people in Grade 9 and 10, 
and 4% or 12 people in Grade 11), comparisons made between the troubled group and the other 
mental health groups were likely underpowered. Replication with larger samples is needed. 
Overall, more differences between latent classes on Grade 12 outcomes were observed in Grade 
11, indicating that the predictive power of latent mental health classes is strongest within a one 
year prior, as opposed to two or three years prior to measurement of the outcomes of interest. 


Previous dual-factor mental health research has also indicated that, among youth 
experiencing distress, those with higher levels of well-being tend to exhibit more positive 
outcomes (e.g., Antaramian et al., 2010). In the current study, this effect was observed in relation 
to anxiety symptoms and life satisfaction (particularly in Grade 11), such that youth in the 
symptomatic but content class, exhibited more positive outcomes than youth in the troubled 
class. However, students in the symptomatic but content class also, on average, reported lower 
levels of internalizing distress than did youth in the troubled class. It is unclear if the presence of 
higher levels of well-being or lower levels of distress led to more positive outcomes for this 
group of students. An advantage of the empirical approach to classification, however, is that it 
allows meaningful differences in average responses on a given indicator to emerge across mental 
health groups; differences that are not acknowledged when groups are created by cut scores. 


Implications for Research and Practice 


The present study contributes to research supporting a comprehensive approach to mental 
health assessment that includes indicators of both well-being and distress. Using an empirical 
approach to complete mental health classification enabled identification of variability in well- 
being and distress observed for four emerging mental health groups. Although, on the surface, 
confirming the presence of four empirically defined mental health groups parallels what has been 
illustrated in previous dual-factor research, empirically identifying groups as opposed to using 
logically determined cut points allowed for meaningful variation in levels of well-being and 
distress indicators to be observed across groups. These results indicate that the cut-point 
approach to forming mental health groups may incompletely capture the complexity in youth’s 
dual-factor mental health profiles. Thus, the current results extend previous research on dual- 
factor mental health and offer continued support for examining both well-being and distress in 
universal screening efforts that can be used to inform prevention and early intervention. 


Results highlight limitations of a binary cut-score approach to classification. Although 
there is error associated with both LPA and cut-point classification, cut-point approaches do not 
allow for examination of the probability of members of one class being classified into (i.e., being 
similar to) another class. Using empirically defined classification allows us to examine the 
accuracy with which youth are placed into groups via estimates of the likelihood of being 
classified into a given class based on one’s most likely latent class membership. Forming groups 
via latent classes, in this study we were able to model the error associated with classification and 
could examine the likelihood of individuals identified as members in one mental health class 
being classified into another class on an aggregate level (Table 3). Results supported strong 
accuracy in classification for the empirically defined mental health groups. However, future 
research is needed to compare differences in classification that may arise when a cut-score versus 
empirical approach is used. For example, investigations can compare the distribution of students 


LATENT CLASS MENTAL HEALTH CLASSIFICATION 15 


assigned to LPA produced mental health classes as compared to group assignment based on cut 
scores as well as any differences in the predictive validity of each mental health class with later 
outcomes. In addition, examining the likelihood of membership in each empirically defined 
mental health class on an individual level (rather than at an aggregate level, as done in this study) 
can be used to further examine accuracy of various classification approaches. 


Overall, the results call for further examination of cut-score approaches to classification 
used to interpret universal complete mental health screening data. Although school-based mental 
health practitioners may lack the resources needed to evaluate screening assessment data using 
LPA, the results of this study highlight that a dichotomous, cut-score approach to complete 
mental health classification may obscure meaningful variation in youths’ complete mental health 
profiles. If limited to using cut-score approaches due to the ease and efficiency of this approach, 
mental health practitioners may wish to utilize additional cut points, especially with regard to 
youth’s well-being, resulting in more than four groups. For example, Moore et al. (2015) used 
universal complete mental health screening results to form nine triage groups informed by three 
psychological risk and four social-emotional strength groups. Concurrently, scholars, mental 
health practitioners, and other school mental health stakeholders are called upon to investigate 
and develop techniques for translating LPA classification parameters into a usable format for 
organizing dual-factor mental health data that are collected and intended to guide intervention. 
The LPA examinations in this study are thus viewed as an initial step necessary for informing 
classification approaches that may be easily accessible to and applied by practitioners. 


This study’s results support dual-factor mental health assessment and intervention. 
Through universal complete mental health screening, schools obtain a comprehensive, dynamic 
picture of their students’ mental health functioning (e.g., Moore et al., 2015). Information from 
universal screening offers predictive information about youths’ later mental health functioning 
and thus should be used to inform a range of interventions implemented at multiple tiers of 
support (von der Embse, Iaccarino, Mankin, Kilgus, & Magen, 2016). Therefore, practitioners 
interested in universal screening are encouraged to identify and co-administer screening tools 
that measure psychological strengths in addition to emotional/behavioral risk, psychological 
distress, or mental illness. When using screening data to link students to relevant interventions, 
practitioners should collaborate with their school and community colleagues to provide 
interventions that focus on supporting youths’ complete mental health. For example, Suldo and 
Shaffer (2008) explain that all youth would benefit from schoolwide approaches to support 
wellness (e.g., social-emotional learning curricula, promoting positive school climate), whereas 
youth with symptomatic but content mental health may benefit from small-group interventions 
that address symptoms of distress while continuing to support wellbeing (e.g., mentoring 
partnerships, check-in/check-out). Youth fitting a troubled profile would receive individualized, 
intensive interventions that are designed to reduce symptoms of mental illness, and to increase 
well-being (e.g., individual counseling, referral for special education evaluation). Through 
assessment and interventions tailored toward wellness promotion and risk prevention and 
treatment, schools can support all students’ complete mental health. 


Limitations and Future Directions 


Although adequate in size for the current analyses, the present sample was restricted in 
geographic diversity, which limits the generalizability of our findings. The sample consisted of 
students attending one school in central California and was limited in size by attrition between 
Grade 9 and 12, when the outcome measures were administered. Additionally, although the 
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percentage of students representing the smallest troubled group was consistent with estimates of 
the proportion of youth who are identified as having severe mental health concerns via universal 
screening (Moore et al., 2015), the sample size of the current study resulted in a small number of 
students comprising the troubled group, thus limiting the power to detect differences between 
this group and the other mental health groups. Additional research is needed with larger, 
geographically diverse samples. Although the profiles observed in the current study provided 
support for the structural stability of dual-factor mental health classes, variability was observed 
in class sizes over the high school years. Research is needed to explore the relative size of 
emerging classes and factors that contribute to shifts in these proportions over time. 


The well-being and distress measures, grades, and social-emotional outcomes relied on 
self-report. Results may have been influenced by mono-method and social desirability bias. 
Moreover, research recommends caution in interpreting self-reported grades (e.g., Kuncel et al., 
2005); hence, additional research examining academic achievement is needed. The use of self- 
reported grades in the current study is further limited by their retrospective nature. In addition, 
although adolescents are recognized as ideal informants of their own internal states (e.g., Smith, 
2007), some research suggests that adolescents may underreport their externalizing behavior 
(e.g., Smith, Pelham, Gnagy, Molina, & Evans, 2000). The lower rates of externalizing problems 
observed may reflect participants’ underestimation of their externalizing behaviors. 


There are limitations in the naming of classes. Most research describing dual-factor 
mental health logically created groups using study-specific well-being and distress criteria. The 
labels adopted for these groups in many studies — complete mental health (also referred to as 
well-adjusted, thriving, mentally healthy), symptomatic but content (inconsistent, externally 
maladjusted), Janguishing (vulnerable, asymptomatic yet discontent), and troubled (highest risk, 
distressed, mentally unhealthy) — have served as a heuristic for each group’s core well-being 
and distress characteristics. Nonetheless, there is incomplete uniformity among dual-factor 
studies in how measures and cut-point criteria are used to form groups, as well as the labels of 
the groups themselves (Kim et al., 2017). In naming the emerging latent classes in the current 
study, we attempted to balance recommendations for use of consistent language to facilitate 
communication among dual-factor mental health stakeholders with recognition that operational 
definitions of complete mental health, moderately mentally healthy, symptomatic but content, 
and troubled mental health vary in the existing research base. The names given to emerging 
classes in this study were selected to parallel seminal research in this area (e.g., Keyes 2006; 
Suldo & Shaffer, 2008), yet represent only one way profiles of wellbeing and distress could be 
labeled. Cross study communication and collaboration among scholars interested in dual-factor 
mental health to operationally define variations in dual-factor mental health is needed. 


The analyses of this study make an important contribution to dual-factor mental health 
research by validating the structural stability of empirically defined mental health classes based 
upon indicators of both well-being and distress. An important next step will be to investigate the 
stability of individuals’ patterns of dual-factor mental health over the high school years. Future 
research should investigate longitudinal trends in youths’ mental health via latent transition 
analysis, which provides estimates of the probabilities of transitioning between classes. Further, 
research examining how individual and contextual factors influence transitions to and from 
identified mental health classes (e.g., factors that influence transition into the troubled class from 
a more flourishing mental health class during the previous year) is important to further inform 
mental health screening and intervention efforts. In addition, research comparing classification 
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and predictive validity of empirically derived versus cut-score defined dual-factor mental health 
groups is important for informing applied classification efforts that impact intervention. 


Understanding mental health as comprised of indicators of well-being and distress is 
important in comprehensive efforts to address risk and promote youth thriving. When used as 
part of universal mental health screening, information gained from assessment of youths’ 
complete mental health can be used to inform intervention at each level of a comprehensive 
service delivery system, including schoolwide, small-group, and individualized interventions 
intended to ameliorate psychopathology and support development of social-emotional strengths 
and youths’ well-being. The current study, using an empirical classification approach provided 
initial information that can inform continuing research into how to classify youth into distinct 
mental health groups for intervention and follow-up efforts after screening assessments that 
foster youths’ positive mental health and well-being. 
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Table 1 


Measures Mean Item Response and Standard Deviations of Mental Health Indicators and Outcomes 


Grade 9 Grade 10 Grade 12 
pa 2 M SD M M 

SEHS-S (Grades 9-11) 

Belief in Self 1-4 .76—-.81 2.87 0.50 3.05 a 

Belief in Others 1-4 80-87 3.14 0.56 3.34 = 

Emotional Competence 1-4 .78—.84 2.98 0.48 3.22 a 

Engaged Living 1-4.677 .86-.91 3.31 0.68 3.39 -— 
SDOQ (Grades 9-11) 

Internalizing 1-3 .67—.75 1.64 044 1.51 = 

Externalizing 1-3 55-67 1.72 0.42 1.50 = 
Prosocial (Grade 12) 

Contribution 1-6 91 4.66 

Life Satisfaction 1-5 .80 4.97 

Depression symptoms 1-4 87 1.58 

Anxiety symptoms 1-4 .90 1.57 

Course grades 1-8 6.44 


Note. SEHS-S = Social Emotional Health Survey — Secondary; SDQ = Strengths and Difficulties 


Questionnaire. Contribution = Contribution to Community subscale of the Positive Youth Development 


Inventory. Life Satisfaction = Brief Multidimensional Students’ Life Satisfaction Scale. Depression 


symptoms = Patient Health Questionnaire. Anxiety symptoms = Generalized Anxiety Disorder Scale. 
Course grades = Self-reported past year grades 1 = mostly F’s ... 6 = mostly B’s...8 = Mostly A’s. See 


online supplemental material for detailed description of each measure. 


'Ttem response range for each measure. 


> SEHS-S and SDQ reliabilities show the range across Grade 9, 10, and 11 administrations. Other 


reliabilities are for measures administered in Grade 12. 


3 The Engaged Living domain is the combination of gratitude (item response range = 1-4), zest (item 


response range = 1-5), and optimism (item response range = 1-5). 
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Table 2 Information Used to Evaluate Tested LPA Dual-Factor Mental Health Models 
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Model Number of Log BIC p-value of p-value of BF cmP Entropy Class Prevalence 
classes likelihood BLRT LMRT 
Grade 9 - 1 -1464.48 2998.61 - - <.001 <.001 - 1.00 
Model 1 2 -1299.40 2709.10 <.001 <.001 <.001 <.001 0.74 4, 55 
(n = 332) 3 -1231.61 2614.15 <.001 0.01 <.001 <.001 0.85 .05, .35, .60 
4 -1197.99 2587.56 <.001 0.55 3.18 0.75 0.78 .06, .31, .20, .43 
5 -1178.83 2589.87 <.001 0.10 23.80 0.24 0.81 OL, .09, .19, .27, .44 
6 -1161.69 2596.21 <.001 0.31 <.001 0.01 0.81 O1, .08, .12, 12, .28, .39 
Grade 9 - 1 -1464.48 2998.61 - - <.001 <.001 - 1.00 
Model 2 2 -1264.67 2674.46 <.001 <.001 <.001 <.001 0.82 33, .67 
(n = 332) 3 -1195.92 2612.43 <.001 0.03 0.23 0.10 0.75 .23, 33, .44 
4* -1156.72 2609.50 <.001 0.20 0.98 0.45 0.79 05, .25, .32, .39 
oF -1118.97 2609.47 <.001 0.26 >100 0.45 0.82 05, .09, .23, .23, .41 
6* -1095.71 2638.41 0.01 0.62 <.001 <.001 0.81 05, .07, .11, .18, .27, .32 
Grade 10 - 1 -1283.37 2636.10 - - <.001 <.001 - 1.00 
Model 1 2 -1101.50 2312.83 <.001 <.001 <.001 <.001 0.75 A9, 51 
(n = 324) 3 -1040.96 2232.21 <.001 0.02 0.09 0.08 0.82 .07, .41, 53 
4 -1018.37 2227.50 <.001 0.39 11.42 0.85 0.78 .06, .21, .32, 41 
3 -1000.57 2232.37 <.001 0.38 799.91 0.07 0.76 07, .09, .17, .32, .35 
6 -987.02 2245.74 0.01 0.54 <.001 <.001 0.78 02, .07, .09, .16, .32, .34 
Grade 10 - 1 -1283.37 2636.10 - - <.001 <.001 - 1.00 
Model 2 2 -1058.99 2262.49 <.001 <.001 <.001 <.001 0.80 42, 58 
(n = 324) 3* -990.87 2201.41 <.001 0.05 0.01 0.01 0.79 15, .35, 51 
4* -948.16 2191.13 <.001 <0.001 >100 0.99 0.80 .09, .13, .38, .40 
3 -919.23 2208.43 <.001 0.11 40.49 <.001 0.84 .10, .12, .13, .29, .36 
6* -885.36 2215.83 <.001 0.03 <.001 <.001 0.84 05, .09, .12, 13, .24, .37 
Grade 11 - 1 -1379.66 2827.40 - - <.001 <.001 - 1.00 
Model 1 2 -1161.17 2430.13 <.001 <.001 <.001 <.001 0.83 38, .62 
(n=291) 3 -1104.56 2356.62 <.001 0.21 <.001 <.001 0.86 .05, .43, 52 
4 -1059.07 2305.36 <.001 0.01 0.03 <.001 0.82 04, .21, .31, .44 
5 -1035.57 2298.07 <.001 0.39 0.17 0.14 0.81 .03, .10, .20, .22, .44 
6 -1013.92 2294.49 <.001 0.67 <.001 0.85 0.82 03, .09, .12, .18, .22, .36 
Grade 11 - 1 -1379.66 2827.40 - - <.001 <.001 - 1.00 
Model 2 2* -1127.24 2396.32 <.001 <0.001 <.001 <.001 0.80 44, 56 
(n=291) 3% -1033.93 2283.45 <.001 0.20 <.001 <.001 0.86 .19, .33, .48 
4* -979.96 2249.26 <.001 0.37 - 1.00 0.87 .06, .16, .30, .48 


Note. Bolded values = preferred model for a given fit index and shaded rows = model selected for each year. 
*log likelihood starting values did not converge, indicating model instability. 
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Table 3 


Average Posterior Class Probability of Most Likely Latent Class Membership by Latent Mental 
Health Class 


Classification Probability 


Grade Most Likely Class Membership 1 pi 3 4 
1. Complete Mental Health 0.94 0.06 0.01 0.00 
Grade 9 2. Moderately Mentally Healthy 0.08 0.86 0.05 0.01 
3. Symptomatic but Content 0.01 0.16 0.83 0.01 
4. Troubled 0.00 0.08 0.07 0.85 
1. Complete Mental Health 0.94 0.04 0.02 0.00 
Grade 10 2. Moderately Mentally Healthy 0.08 0.85 0.08 0.00 
3. Symptomatic but Content 0.04 0.15 0.81 0.01 
4. Troubled 0.00 0.04 0.09 0.85 
1. Complete Mental Health 0.86 0.14 0.00 0.00 
Grade 11 2. Moderately Mentally Healthy 0.05 0.90 0.05 0.00 
3. Symptomatic but Content 0.00 0.08 0.91 0.01 
4. Troubled 0.00 0.00 0.02 0.98 


Note. Shaded cells indicate accuracy of classification 
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Table 4 
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Mean Item Responses and Standard Errors of Academic and Social-Emotional Distal Outcomes in Grade 12 Across Mental Health Classes 


Grade 12 Outcomes 
(Response Scale) 


Self-Reported Contribution to Life Depression Anxiety 
Grade Mental Health Class (% in class) Grades Community Satisfaction Symptoms Symptoms 
(range 1-8) (range 1-6) (range 1-6) (range 1-3) (range 1-3) 
Grade 9 Complete Mental Health (30.5%) 6.47 (.16)a 5.04 (.11)a 5.18.10). 1.58 (.07)a 1.54 (.08), 
(n = 332) Moderately Mentally Healthy (43.4%) 6.63 (.12)a 4.61 (.09)a 5.07 (.07).2 1.48 (.05)a 1.42 (.06). 
Symptomatic but Content (20.3%) 6.03 (.20)a 4.37 (.13)p 4.58 (.14)) 1.91 (10), 2.02 (.13)p 
Troubled (5.7%) 6.45 (.44)a 4.15 (.20)p 4.57 (.30)a 1.37 (.14)a 1.52 (.17)ab 
Grade 10 Complete Mental Health (40.8%) 6.72 (.12)a 4.96 (.09). 5.35 (.07). 1.39 (.05)a 1.32 (.05)a 
(n = 324) Moderately Mentally Healthy (32.0%) 6.44 (.16)ab 4.56 (.11)b 4.83 (.10)h = 1.45 C07 ac 1.55 (.08)ab 
Symptomatic but Content (21.2%) 6.03 (.22)p 4.39 (15) 4.63 (14), 2.12 C.11)p 2.01 (.13)p 
Troubled (6.0%) 6.00 (.44)av 4.16 (.19)be 4.50 (.21)p 1.84 (.15 pe 2.03 (.20)» 
Grade 11 Complete Mental Health (20.5%) 6.79 (.21)a 5.32 (.13)a 5.47 (12). 1.29 (.07)a 1.34 (.10)a 
(n= 291) Moderately Mentally Healthy (44.3%) 6.60 (.12)a 4.88 (.08)p 5.20 (.06)2 1.44 (.05)a 1.43 (.06)a 
Symptomatic but Content (31.3%) 6.29 (.14) ab 4.12 (.10). 4.52 (.09)p 1.82 (.07)b 1.82 (.07)b 
Troubled (3.8%) 5.10 (.51)b 3.64 (.29). 3.57 (.33)¢ 2.36 (.20)b 2.51 (.24)¢ 


Note. Means that do not share subscripts differ at p < .01. 


Complete Mental Health Classification in Adolescents: Online Supplement 24 


Grade 9 (n = 332) 


—o— CMH (30.5%) ll» MMH (43.4%) —a-- SBC (20.3%) —@— TRB (5.7%) 


Estimated Means 
WwW 


BIS BIO EC EL INT EXT 
Grade 10 (n = 324) 


—?— CMH (40.8%) &— MMH (32.0%) —&-- SBC (21.2%) ---@--- TRB (6.0%) 


Estimated Means 
wo IN 


N 


BIS BIO EC EL INT EXT 


Grade 11 (n= 291) 


) 
—o CMH (20.5%) —l— MMH (44.3%) —&#-- SBC (31.3%) —@— TRB (3.8%) 


Estimated Means 
vw IN 


i) 


BIS BIO EC EL INT EXT 


ay 


Figure 1. Dual-factor mental health profile plots for the four-class models for Grade 9 through Grade 11. Class size 
information is presented in the legend. (Note. BIS = belief in self, BIO = belief in others, EC = emotional 
competence, EL = engaged living, INT = internalizing distress, EXT = externalizing distress. CMH = complete 
mental health class, MMH = moderately mentally healthy class, SBC = symptomatic but content class, TRB = 
troubled class.) The mean-value range for BIS, BIO, and EC was | to 4; for EL was 1 to 4.67; and for INT and EXT 


was | to 3. 
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Measures 
Complete Mental Health Measures 


The following measures were administered annually at the beginning of Grades 9, 10, 
and 11. These measures were used in latent profile analyses to examine patterns of complete 
mental health. 


Social Emotional Health Survey-Secondary (SEHS-S). The 36-item SEHS-S assesses 
12 positive psychological dispositions which load onto four second-order positive mental health 
domains and a third-order factor of covitality (Furlong, Dowdy, & Nylund-Gibson, 2018; 
Furlong, You, Renshaw, Smith, & O’Malley, 2014; You et al., 2014). The four positive-mental- 
health domains in the SEHS-S model are: belief-in-self (comprised of self-efficacy, self- 
awareness, persistence), belief-in-others (school support, peer support, family coherence), 
emotional competence (emotional regulation, empathy, self-control), and engaged living 
(optimism, gratitude, zest). Nine items, consisting of three items from each of three first-order 
psychological dispositions, comprise each of the four positive mental health domains. 

In the current study, mean scores for the four second-order positive psychological 
domains (belief-in-self, belief-in-others, emotional competence, engaged living) were computed 
and used as indicators of well-being for each year of data collection. One item on the self- 
awareness subscale of the belief-in-self domain (item 6, “I understand why I do what I do”) was 
missing for all students on the 2015-2016 (Grade 11) survey. Given that the inter-item 
correlations of items within the self-awareness subscale on the SEHS-S (r= .17 to .40) and the 
second-order belief-in-self domain (r = .21 to .28; Renshaw, 2015) have been observed to fall 
within the recommended range (1.e., between .20 and .40; Allen & Yen, 2002; Piedmont, 2014), 
indicating reasonable homogeneity and unique variance, the mean item response for the belief- 
in-self domain for Grade 11 was computed without this missing item. Internal consistency 
reliability for each of the second-order psychological domains have been found to be adequate 
(e.g., belief-in-self, 0 = .76; belief-in-others, 0 = .81; emotional competence, a = .78; engaged 
living, a = .87; You et al., 2014). In the current study, Cronbach’s a ranged from .76 (Grade 10) 
to .84 (Grade 11) for belief-in-self, .80 (Grade 9) to .87 (Grade 11) for belief-in-others, .78 
(Grade 9) to .84 (Grade 11) for emotional competence, and .86 (Grade 9) to .91 (Grade 11) for 
engaged living. 


Strengths and Difficulties Questionnaire (SDQ). The SDQ is a 25-item self-report 
questionnaire designed to measure youths’ behavior and feelings over the previous six months 
(Goodman, 1997, 1999). Students respond to each item using a three-point response scale (1 = 
not true, 2 = somewhat true, 3 = certainly true). A three-factor structure, including emotional 
distress/withdrawal, behavioral reactivity/conduct problems, and prosocial behaviors/peer 
competence, proposed by Dickey and Blumberg (2004) and Ruchkin et al. (2008), has been 
validated with U.S. youth and supports superior reliability estimates over the originally theorized 
five-factor SDQ model (Goodman, 1997, 1999). In the present study, consistent with 
recommendations for measurement efficiency in applied screening settings, the five highest 
loading items, supported in the Ruchkin et al. (2008) three-factor model, were used for each of 
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the emotional distress/withdrawal (items 3, 6, 8, 13 and 16; 1 = .47 to .60) and the behavioral 
reactivity/conduct problems factors (items 2, 5, 10, 15, and 22; 4 = .56 to .62). The emotional 
distress/withdrawal items were used as a measure of internalizing distress (e.g., “I worry a lot’) 
while the behavioral reactivity/conduct problems items were used as a measure of externalizing 
distress (e.g., “I get very angry and often lose my temper’). 

To examine the hypothesized two-factor structure of the 10 items used in the current 
study, an exploratory factor analysis (EFA) specifying one to three factors was performed using 
the total Grade 9 sample from 2013-2014 (N = 497). Using criteria specified by Hu and Bentler 
(1999) and Browne and Cudeck (1989), a two-factor model comprised of internalizing problems 
and externalizing problems factors yielded the best empirical and substantive fit: Root Mean 
Square Error of Approximation (RMSEA) = .07, CI 90% [.05, .09], Comparative Fit Index (CFI) 
= .93, Tucker Lewis Index (TLI) = .89. However, one item hypothesized to measure 
externalizing distress (item 5, “I get angry and often lose my temper’’) loaded poorly on the 
factor with externalizing items (A = .11) but strongly on the factor with internalizing items (A = 
.51). Therefore, this item was removed from the analysis. A final confirmatory factor analysis 
(CFA) model, specifying four items on the externalizing scale and five items on the internalizing 
scale yielded adequate fit: RMSEA = .08, CI 90% [.07, .10], CFI = .94; TLI = .92. In the current 
study, mean scores for the final five items from the emotional/distress and four items from 
behavioral reactivity/conduct problems were computed and used as indicators of internalizing 
and externalizing distress, respectively, for each year of data collection. Internal consistency 
reliability (a) for the internalizing and externalizing composites in the current study ranged from 
.67 (Grade 9) to .75 (Grade 11), and .55 (Grade 9) to .67 (Grade 11), respectively. 
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Table 1 
Bivariate Correlations, Means, and Standard Deviations for LPA Indicators and Outcomes 
Grade 9 Grade 10 
1 2 3 4 5 6 7 8 9 10 11 12 
1. BIS - 
2. BIO 0.56 - 
Grade9 3.EC 0.53 0.48 - 
(n= 332) 4. EL 0.57 0.51 0.44 =- 
5. INT -0.35 -0.26 -0.06' -0.41 - 
6. EXT -0.28 -0.18 -0.22 —_-0.06° 0.37 - 
7. BIS 0.57 0.39 0.36 0.45 -0.42 -0.28 - 
8. BIO 0.36 0.60 0.33 0.44 -0.25 -0.14" 0.54 - 
Grade 10 9.EC 0.35 0.28 0.57 0.32 -0.16"  -0.16" 0.52 0.39 - 
(n= 324) 10.EL 0.30 0.29 0.24 0.54 -0.33 -0.12* 0.56 049 0.42 - 
11. INT -0.25 -0.15™ = -0.03* = -0.37 0.54 0.15" | -0.40 -0.30 -0.18 -0.42. - 
12. EXT -0.32 -0.21 -0.23 — -0.22 0.18 0.52 -0.36 -0.27  -0.27 -0.27 0.32. - 
13. BIS 0.51 0.34 0.27 0.30 -0.37 -0.22 0.63 0.43 0.40 0.39 -0.36 -0.26 
14. BIO 0.39 0.54 0.26 0.31 -0.25 -0.15* 0.43 0.62 0.31 0.34 -0.24 -0.22 
Grade 1]  15.EC 0.34 0.28 0.44 0.23 -0.16™  -0.20 0.44 O31 0.56 0.29 -0.13" -0.31 
(n= 291) 16.EL 0.30 0.27 0.20 0.36 -0.30 -0.07* 0.45 0.46 0.35 0.56 -0.32 -0.25 
17. INT -0.19"" = -0.21 -0.02* -0.17" 0.47 0.19 -0.39 -035 -0.19"  -0.32 0.55 0.21 
18. EXT -0.11*  -0.19" = -0.09t —_-0.10* 0.18 0.43 -0.27. -0.25 -0.21 -0.18 0.25 0.50 
19. Course Grades 0.19 0.15" 0.14" 0.04 -0.12* -0.10° 0.27. 0.23 0.20 0.06 -0.10* -0.18"* 
20. Contribution 0.24 0.32 0.28 0.17 -0.13 -0.09 0.33 0.33 0.39 0.23 -0.12 -0.19 
Cas 21. Life Satisfaction 0.18% 031 O12" 025 -0.24 -0.08' | 032 038 0.26 026 -027 -0.19 
22. Depression Symptoms -0.044 = -0.12" 0.11°  -0.07* 0.28 0.20 -0.26 -0.23 -0.08" = -0.19 0.35 0.21 
23. Anxiety Symptoms -0.05* = -0.15** 0.04* -0.16"* 0.30 0.19 -0.31 -0.28  -0.09" -0.24 0.35 0.18"* 
M 2.87 3.14 2.98 3.31 1.64 1.72 3.05 3.34 3.22 3.39 1.51 1.50 
SD 0.50 0.56 0.48 0.68 0.44 0.42 0.44 O50 0.44 0.60 0.42 0.45 


All p < .001 unless otherwise noted. ““p < .01, “p < .05, *p > .05 


Note. BIS = belief in self, BIO = belief in others, EC = emotional competence, EL = engaged living, INT = internalizing distress, EXT = externalizing distress, 
Contribution = Contribution to Community subscale of the Positive Youth Development Inventory, Life Satisfaction = Brief Multidimensional Students’ Life 


Satisfaction Scale, Depression symptoms = Patient Health Questionnaire, Anxiety symptoms = Generalized Anxiety Disorder Scale. 
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Table 1 (cont.) 
Bivariate Correlations, Means, and Standard Deviations for LPA Indicators and Outcomes 
Grade 11 Grade 12 
13 14 15 16 17 18 19 20 21 22 23 
1. BIS 
2. BIO 
3. EC 
Grade 9 (n= 332) 4 EL 
5. INT 
6. EXT 
7. BIS 
8. BIO 
9. EC 
Grade 10 (n= 324) 10. EL 
11. INT 
12. EXT 
13. BIS - 
14. BIO 0.63 - 
15. EC 0.62 0.50 - 
nae Eee deen 0.58 0.62 0.50 z 
17. INT -0.55 -0.45 -0.28 -0.44 - 
18. EXT -0.37 -0.33 -0.29 -0.28 0.51 - 
19. Course Grades 0.35 0.29 0.19" 0.12* -0.20 -0.12" Z 
20. Contribution 0.39 0.48 0.42 0.41 -0.28 -0.21 0.38 - 
Grade 12 (n= 332) 21. Life Satisfaction 0.35 0.49 0.28 0.44 = -0.42 -0.28 0.32 0.53 - 
22. Depression Symptoms -0.29 -0.34 -0.19" -0.35 0.53 0.36 -0.23 —_-0.32 -0.51 - 
23. Anxiety Symptoms -0.26 -0.30 -0.16 -0.29 0.47 0.29 -0.20 —_-0.20 -0.47 0.78 - 
M 3.04 3.29 3.24 3.36 1.57 1.45 6.44 4.66 4.97 1.58 1.57 
SD 0.53 0.59 0.49 0.68 0.48 0.45 1.53 0.99 0.85 0.59 0.68 


All p < .001 unless otherwise noted. “p < .01, “p < .05, ‘p > .05 


Note. BIS = belief in self, BIO = belief in others, EC = emotional competence, EL = engaged living, INT = internalizing distress, EXT = externalizing distress, 
Contribution = Contribution to Community subscale of the Positive Youth Development Inventory, Life Satisfaction = Brief Multidimensional Students’ Life 
Satisfaction Scale, Depression symptoms = Patient Health Questionnaire, Anxiety symptoms = Generalized Anxiety Disorder Scale. 
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Analysis Syntax 


Latent Profile Analysis: Grade 9, Four-Class Solution 


DATA: File is LPAwithDistals_Covariates.dat; 


VARIABLE: 


NAMES ARE SEHS_BSX SEHS_BOX SEHS_ECX SEHS_ELX SDQINTX SDQEX4X SEXX ETHNRX 
PYDI_MNA PHQ8MNA GAD7MNA CHKSGRDA BMLSSMNA; 


USEVARIABLE = SEHS_BSX SEHS_BOX SEHS_ECX SEHS_ELX SDQINTX SDQEX4x; 
missing are all(9999); 


classes = c(4); 


ANALYSIS: type = mixture; 
starts = 500 100; 


processors = 4 (starts); 


OUTPUT: tech1 tech10 tech11 tech14 


patterns residual svalues sampstat entropy; 


PLOT: type=plot3; 
series = SEHS_BSX SEHS_BOX SEHS_ECX SEHS_ELX SDQINTX SDQEX4X(*); 


Manual BCH Analysis STEP 1 — Distal Outcomes Analysis, Controlling for Effect of Covariates 


BCH STEP 1: 


DATA: FILE IS LPAwithDistals_Covariates.dat; 


VARIABLE: 


NAMES ARE SEHS_BSX SEHS_BOX SEHS_ECX SEHS_ELX SDQINTX SDQEX4X SEXX ETHNRX 
PYDIMNA PHQ8MNA GAD7MNA CHKSGRDA BMLSSMNA; 


USEVARIABLE = SEHS_BSX SEHS_BOX SEHS_ECX SEHS_ELX SDQINTX SDQEX4X; 
MISSING ARE ALL(9999): 
CLASSES = c(4); 


AUXILIARY = SEXX ETHNRX PYDI_MNA PHQ8MNA GAD7MNA CHKSGRDA BMLSSMNA; 
‘auxiliary variables are covariates and distal outcomes 
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ANALYSIS: 
TYPE = mixture; 
STARTS = 500 100; 
PROCESSORS = 4 (starts); 
OUTPUT: tech! tech10 tech11 tech14 patterns residual svalues sampstat entropy; 


PLOT: 
TY PE=plot3; 
SERIES = SEHS_BSX SEHS_BOX SEHS_ECX SEHS_ELX SDQINTX SDQEX4X(*); 


SAVEDATA: !saved file is used in next steps 
FILE IS bchweights4grade9.dat; 
SAVE=bchweights; 

MISSFLAG=9999; 


Manual BCH Analysis STEP 2 — Distal Outcomes Analysis, Controlling for Effect of Covariates 


BCH STEP 2: 


DATA: FILE IS bchweights4grade9.dat; 


!This is reading in the savedata file that we created from step 1 


VARIABLE: 
NAMES ARE SEHS_BSX SEHS_BOX SEHS_ECX SEHS_ELX SDQINTX SDQEX4X 


SEXX ETHNRX PYDI_LMNA PHQ8MNA GAD7MNA CHKSGRDA BMLSSMNA BCHW1 BCHW2 
BCHW3 BCHW4 CPROB1 CPROB2 CPROB3 CPROB4 C; 


!new variable names provided in output of step 1 
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USEVARIABLE = SEXX ETHNRX PYDI_MNA PHQ8MNA GAD7MNA CHKSGRDABMLSSMNA bchw1 


bchw2 bchw3 bchw4; 


covariates and distal outcomes included in variable statement as well as the BCH weights (one !for each class) 


MISSING ARE ALL(9999); 
CLASSES = c(4); 
TRAINING = BCHW1-BCHW4 (bch); 


!treating bch weights as training data 
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DEFINE: 
CENTER SEXX ETHNRX (grandmean); 


centering covariates 


ANALYSIS: 
TYPE = mixture; 
STARTS = 0; 


'In the second step of the BCH methods, do not use random starts because we have the best 
lidentified model 


MODEL: 
%overall% 

C on SEXX ETHNRX; 
PYDI_MNA on SEXX ETHNRX; 
PHQ8MNA on SEXX ETHNRX; 
GAD7MNA on SEXX ETHNRX; 
CHKSGRDA on SEXX ETHNRX; 
BMLSSMNA on SEXX ETHNRX; 


Joct# 1% 

[PYDI_MNA](d11); !naming distal 1 class 1 as d11 
[PHQ8MNA](d21); !naming distal 2 class 1 as d21 

[GAD7MNA](d31); !naming distal 3 class 1 as d31 
[CHKSGRDA](d41); 

[BMLSSMNA](d51); 


Goc#2% 
[PYDI_MNA](d12); 
[PHQ8MNA|(d22); 
[GAD7MNA (432); 
[CHKSGRDA|(d42); 
[BMLSSMNA (452); 


Toc#3% 
[PYDI_MNA|(d13); 
[PHQ8MNA |(d23); 
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[GAD7MNA](d33); 
[CHKSGRDA](d43); 
[BMLSSMNA](d53); 


oct % 
[PYDI_MNA](d14); 
[PHQ8MNA|(d24); 
[GAD7MNA (434); 
[CHKSGRDA](d44); 
[BMLSSMNA (454); 


MODEL CONSTRAINT: 
!The syntax below creates new variables that are all possible pairwise differences between 
‘distal outcomes for each class 
new(d11_d12 d11_d13 d11_d14 
d12_d13 d12_d14 
d13_d14 


d21_d22 d21_d23 d21_d24 
d22_d23 d22_d24 
d23_d24 


d31_d32 d31_d33 d31_d34 
d32_d33 d32_d34 
d33_d34 


d41_d42 d41_d43 d41_d44 
d42_d43 d42_d44 
d43_d44 


d51_d52 d51_d53 d51_d54 
d52_d53 d52_d54 
d53_d54); 


!The syntax below is testing if the difference between the means for the distal outcomes for 
!the classes is significantly different from zero 


dl1_d12=d11 - d21; 
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d11_d13=d11 - d13; 
dl1_d14=d11 - d14; 
d12_d13 = d12 - d13; 
d12_d14=d12- d14; 
d13_d14=d13 - d14; 


d21_d22 = d21 - d22; 
d21_d23 = d21 - d23; 
d21_d24 = d21 - d24; 
d22_d23 = d22 - d23; 
d22_d24 = d22 - d24; 
d23_d24 = d23 - d24; 


d31_d32 = d31 - d32; 
d31_d33 = d31 - d33; 
d31_d34 = d31 - d34; 
d32_d33 = d32 - d33; 
d32_d34 = d32 - d34; 
d33_d34 = d33 - d34; 


d41_d42 = d41 - d42; 
d41_d43 = d4l - d43; 
d41_d44 = d4l - d44; 
d42_d43 = d42 - d43; 
d42_d44 = d42 - d44; 
d43_d44 = d43 - d44; 


d51_d52 = d51 - d52; 
d51_d53 = d51 - d53; 
d51_d54 = d51 - d54; 
d52_d53 = d52 - d53; 
d52_d54 = d52 - d54; 
d53_d54 = d53 - d54; 
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